On demand testing as a service for base text direction verification testing

ABSTRACT

Methods and systems for testing base text direction (BTD) include receiving one or more images captured by an end-user system. Each of the one or more images displays respective text test case information. Each of the one or more images is compared to a respective reference image associated with a respective text test case. It is determined whether the end-user system produces BTD errors based on the comparison in accordance with one or more BTD error rules.

BACKGROUND Technical Field

The present invention generally relates to text display and, moreparticularly, to testing base text direction.

Description of the Related Art

While western languages are predominately written from left to right,many languages are written from right to left. For example Arabic andHebrew are written and displayed from the right side of a paper orscreen to the left. Bidirectional script support is the capability of acomputer system to correctly display bi-directional text.

Early computer systems were designed only for support of a singlewriting system, typically displaying scripts left to right, and wereusually based on the Latin alphabet only. Adding new character sets andcharacter encodings enabled a number of other left-to-right scripts tobe supported, but right-to-left scripts were not well supported.Furthermore, mixing left-to-right and right-to-left scripts was notpractical.

In modern systems, scripts are displayed in accordance with the basetext direction assigned to a phrase, paragraph, or block that containsit. The base text direction established a directional context that thebi-directional text system refers to decide how to handle the text.

Base text direction verification is a test of the order in whichbi-directional text segments are displayed inside a text document.Currently, base text direction verification is conducted manually, whichexposes the end-user application under test to third-party testers andresults in a relatively high-cost associated with human testing. Inaddition, current base text direction testing is dependent on theplatform where the end-user application under test is executed.

SUMMARY

A method for testing base text direction (BTD) includes receiving one ormore images captured by an end-user system. Each of the one or moreimages displays respective text test case information. Each of said oneor more images is compared to a respective reference image associatedwith a respective text test case. It is determined whether the end-usersystem produces BTD errors based on the comparison in accordance withone or more BTD error rules.

A method for testing BTD includes transmitting text test caseinformation that has a text string and an associated BTD to an end-usersystem. One or more images captured by the end-user system is received.Each if the one or more images displays respective text test caseinformation. The received one or more images are filtered to removenoise. Each of the filtered one or more images is compared to arespective reference image associated with a respective text test case.It is then determined whether the end-user system produces BTD errorsbased on the comparison in accordance with one or more BTD error rules.Each BTD error rule includes a set of matching test cases and a set ofmismatching test cases associated with each of a plurality of types ofBTD error.

A system for testing base text direction includes a network interfaceconfigured to receive one or more images captured by an end-user system.Each of the one or more images displaying respective text test caseinformation. An image comparison module includes a processor configuredto compare each of the one or more images to a respective referenceimage associated with a respective text test case and to determinewhether the end-user system produces BTD errors based on the comparisonin accordance with one or more BTD error rules.

These and other features and advantages will become apparent from thefollowing detailed description of illustrative embodiments thereof,which is to be read in connection with the accompanying drawings.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

The disclosure will provide details in the following description ofpreferred embodiments with reference to the following figures wherein:

FIG. 1 is a block diagram of a Testing as a Service (TaaS) system forbase text direction (BTD) testing in accordance with the presentprinciples;

FIG. 2 is a set of BTD test cases in accordance with the presentprinciples;

FIG. 3 is a block/flow diagram of a method for BTD testing in accordancewith the present principles;

FIG. 4 is a block diagram of a BTD testing system in accordance with thepresent principles;

FIG. 5 is a block diagram of a processing system in accordance with thepresent principles;

FIG. 6 is a diagram of a cloud computing environment according to thepresent principles; and

FIG. 7 is a diagram of abstraction model layers according to the presentprinciples.

DETAILED DESCRIPTION

Embodiments of the present invention provide a base text direction (BTD)verification through testing as a service. The present embodimentscompares pairs of images for BTD test cases, provided by both the BTDtesting system and the end-users (including both developers andtesters), which allows for the system to be independent of the end-userplatform.

The present embodiments thereby significantly lower the cost of BTDverification testing compared to human manual verification. By comparingimages, regardless of the end-user application implementation, BTDtesting of any application type (e.g., web, mobile, or desktop) isprovided. In addition, because the test cases are sent to the end user,the end user's application is not exposed to any third parties, therebyproviding security to the end user's development process. The presentembodiments use images in standardized formats to maintain compatibilitywith all end-user platforms.

It should be understood that the present embodiments provide significantadvantages over existing testing technologies. In particular, whereasend users (e.g., application developers) may find it difficult toperform rigorous BTD verification on their own, the present embodimentsperform such testing for them, providing reliable and secureinformation, thereby enabling developers to improve regionalization andlanguage support in their applications.

It is specifically contemplated that BTD verification may be performedon a cloud computing system using Platform as a Service (PaaS). Theapplication can be provisioned to developers and testing users as aspecial type of Software as a Service (SaaS) referred to herein asTesting as a Service (TaaS). It is to be understood in advance that,although this disclosure includes a detailed description of cloudcomputing, implementation of the teachings recited herein are notlimited to a cloud computing environment. Rather, embodiments of thepresent invention are capable of being implemented in conjunction withany other type of computing environment now known or later developed.

To perform BTD verification, the present embodiments acquire imagesshowing the text in question from a set of testing third-party users.The images are processed, for example in a cloud computing system, andthen compared to each other, with matches and mismatches being recorded.The matching statistics are tested using a set of rules to identify BTDerrors. There will be different sets of rules for each pair ofbidirectional languages. The present embodiments are discussed in thecontext of English (a left-to-right language) and Arabic (aright-to-left language).

Referring now to FIG. 1, a TaaS system 100 is shown. One or morethird-party user systems 102 are used to run an application under test.The third-party user systems 102 include a user interface that displaystext in accordance with a BTD test case, having received the input textof the text case (along with attendant information such as font name andfont size) from the image analysis module 104. It is specificallycontemplated that unstructured text may be used that is composed ofdifferent segments and is based on bi-directional characters. The usersystem 102 displays the input text and captures an image of the text asdisplayed. The images of the displayed test cases are forwarded to theimage analysis module 104. Additional information may also be forwarded,including font name and font size for the two languages under test.

It should be understood that the image analysis module 104 isspecifically contemplated as being a cloud computing system, but thefunctions described herein may also be performed by a local or remotecentralized server. The image analysis module 104 filters noise from thescreen captures sent by the third-party user systems 102. The imageanalysis module 104 may also convert the uploaded screen captures to animage format appropriate for storage in an image repository 108. Thescreen captures may also be resized to a standard size for the imagerepository 108, with the text from the test cases being located at aspecified location in the image, for example by cropping the images tofit exactly only the text area in the image.

Image comparison module 106 retrieves images stored in the imagerepository 108 for the test cases and compares pairs of imagescorresponding to each test case. Mismatched images will have differentword sequences in the test case, which would result in a largedifference from comparison in the images. In contrast, small differencesfrom the comparison could result from, for example, noise that can beignored by selecting a matching tolerance threshold. A similarity metricis used by the image comparison module 106 to compare the two and togenerate a similarity score, with similarity scores below a thresholdcorresponding to mismatched images. All matches and mismatches betweenpairs of images are recorded corresponding to the test cases.

The image comparison module 106 then applies a set of rules to thematch/mismatch record to identify any BTD errors that have occurred.Different pairs of languages will have different sets of rules. WhileEnglish and Arabic are discussed in detail herein, it should berecognized that any pair of left-to-right and right-to-left languagesmay be used instead. The image repository 108 is linked to the imagecomparison module 106 and stores the test case images along with theirrespective BTD setting values. There will be a different set of imagesfor each pair of languages. A report module 110 compiles a report for anend user or software designer that describes any BTD errors that werelocated.

Referring now to FIG. 2, an exemplary set of test cases is shown. Eachrow illustrates a different test case, with the test case number beingshown in row 202, the input text being shown in row 204, the BTD settingvalue being shown in row 206, and the expected correct visual outputbeing shown in row 208. Each text test case is a sequence of wordsselected to test a specific type of BTD error.

The text test cases are written in a specific font type andsize—preferably a large, bold font to facilitate image comparison. Thetext images 208 are generated for each text test case at a specificlocation in the respective images. Test cases such as these are storedin the image repository 108 and are used to test for particular BTDerrors in end-user applications. For example, the following tableillustrates how the test cases of FIG. 2 may be used to identify BTDerrors. As used herein, there are three possible BTD properties for agiven piece of text. The text may be designated as being displayedright-to-left, left-to-right, or based on context. For right-to-left andleft-to-right, the text will always be ordered as indicated. Forcontextual ordering, the text is ordered based on the first character ofthe text. For example, if the text starts with an Arabic character, itwill be displayed as right-to-left text, while if it starts with a Latincharacter, it will be displayed as left-to-right.

Error # Error description Passing test cases Failing test cases 1 AlwaysLTR 1, 3, 4 2, 5, 6 2 Always RTL 2, 5, 6 1, 3, 4 3 Always contextual 1,3, 4, 6 2, 5

An error arises then if the system or software being tested by theend-user application fails to render the test text in the mannerindicated by the test case's BTD property. If the end-user applicationalways displays bi-directional text left-to-right (error #1), then itwill pass test cases 1, 3, and 4 from the test cases of FIG. 2, but willfail on test cases 2, 5, and 6, because it will incorrectly displayright-to-left text and contextual text as being left-to-right.Similarly, if the end-user application always displays bi-directionaltext right-to-left (error #2), then it will pass test cases 2, 5, and 6and fail on test cases 1, 3, and 4. If the end-user application alwaysdisplays bi-directional text contextually (error #3), then it will passtest cases 1, 3, 4, and 6 and fail on test cases 2 and 5. The reportgenerated by report module 110 may include the indication of the errornumber to identify the BTD error and may optionally provide additionalinformation that specifies the test cases which the end-user applicationfailed.

This table therefore represents a set of rules governing testing. If aparticular end-user application 102 passes certain test cases and failscertain other test cases, then a respective error is generated and theend user developer can respond accordingly.

Referring now to FIG. 3, a method for testing end-user applications'bi-directional text support is shown. Block 302 receives text test casesat the end user 102. As noted above, each test case includes a string oftext and instructions on how the text is to be displayed (e.g., the BTDand any associated font information). Block 304 then graphically rendersthe text test cases at the end user 102 in accordance with theinstructions. This step uses the end-user application to display thetext, but errors in the application's design may result in inaccurateBTD display. Block 306 therefore captures images of the displayed texttest cases and block 308 uploads the captured images to image analysismodule 104.

Block 310 generates clean images from the captured images at imageanalysis module 104, for example by noise-filtering and resizing theimages such that the captured text is positioned correctly for matchingwith reference images. Block 312 then matches the clean images to storedreference images associated with each respective test case at the imagecomparison module 106 using an image similarity metric. Exemplary imagesimilarity metrics include mean squared error and peak signal-to-noiseratio, but it should be understood that any appropriate image similaritymetric may be used. In one example, block 312 generates a similarityscore and then compares the similarity score to a similarity threshold,with scores that fall below representing mismatches between the cleanimage and the reference image.

Block 314 uses the matches and mismatches determined by block 312 toidentify BTD errors. As noted above, block 314 may use a set of rules todetermine what BTD error has occurred based on which test cases matchthe expected reference image and which test cases fail to match theexpected reference image. Block 316 then reports any BTD errors to theend user, so that the error can be corrected.

The present invention may be a system, a method, and/or a computerprogram product. The computer program product may include a computerreadable storage medium (or media) having computer readable programinstructions thereon for causing a processor to carry out aspects of thepresent invention.

The computer readable storage medium can be a tangible device that canretain and store instructions for use by an instruction executiondevice. The computer readable storage medium may be, for example, but isnot limited to, an electronic storage device, a magnetic storage device,an optical storage device, an electromagnetic storage device, asemiconductor storage device, or any suitable combination of theforegoing. A non-exhaustive list of more specific examples of thecomputer readable storage medium includes the following: a portablecomputer diskette, a hard disk, a random access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), a static random access memory (SRAM), a portablecompact disc read-only memory (CD-ROM), a digital versatile disk (DVD),a memory stick, a floppy disk, a mechanically encoded device such aspunch-cards or raised structures in a groove having instructionsrecorded thereon, and any suitable combination of the foregoing. Acomputer readable storage medium, as used herein, is not to be construedas being transitory signals per se, such as radio waves or other freelypropagating electromagnetic waves, electromagnetic waves propagatingthrough a waveguide or other transmission media (e.g., light pulsespassing through a fiber-optic cable), or electrical signals transmittedthrough a wire.

Computer readable program instructions described herein can bedownloaded to respective computing/processing devices from a computerreadable storage medium or to an external computer or external storagedevice via a network, for example, the Internet, a local area network, awide area network and/or a wireless network. The network may comprisecopper transmission cables, optical transmission fibers, wirelesstransmission, routers, firewalls, switches, gateway computers and/oredge servers. A network adapter card or network interface in eachcomputing/processing device receives computer readable programinstructions from the network and forwards the computer readable programinstructions for storage in a computer readable storage medium withinthe respective computing/processing device.

Computer readable program instructions for carrying out operations ofthe present invention may be assembler instructions,instruction-set-architecture (ISA) instructions, machine instructions,machine dependent instructions, microcode, firmware instructions,state-setting data, or either source code or object code written in anycombination of one or more programming languages, including an objectoriented programming language such as Smalltalk, C++ or the like, andconventional procedural programming languages, such as the “C”programming language or similar programming languages. The computerreadable program instructions may execute entirely on the user'scomputer, partly on the user's computer, as a stand-alone softwarepackage, partly on the user's computer and partly on a remote computeror entirely on the remote computer or server. In the latter scenario,the remote computer may be connected to the user's computer through anytype of network, including a local area network (LAN) or a wide areanetwork (WAN), or the connection may be made to an external computer(for example, through the Internet using an Internet Service Provider).In some embodiments, electronic circuitry including, for example,programmable logic circuitry, field-programmable gate arrays (FPGA), orprogrammable logic arrays (PLA) may execute the computer readableprogram instructions by utilizing state information of the computerreadable program instructions to personalize the electronic circuitry,in order to perform aspects of the present invention.

Aspects of the present invention are described herein with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems), and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer readable program instructions.

These computer readable program instructions may be provided to aprocessor of a general purpose computer, special purpose computer, orother programmable data processing apparatus to produce a machine, suchthat the instructions, which execute via the processor of the computeror other programmable data processing apparatus, create means forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks. These computer readable program instructionsmay also be stored in a computer readable storage medium that can directa computer, a programmable data processing apparatus, and/or otherdevices to function in a particular manner, such that the computerreadable storage medium having instructions stored therein comprises anarticle of manufacture including instructions which implement aspects ofthe function/act specified in the flowchart and/or block diagram blockor blocks.

The computer readable program instructions may also be loaded onto acomputer, other programmable data processing apparatus, or other deviceto cause a series of operational steps to be performed on the computer,other programmable apparatus or other device to produce a computerimplemented process, such that the instructions which execute on thecomputer, other programmable apparatus, or other device implement thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof instructions, which comprises one or more executable instructions forimplementing the specified logical function(s). In some alternativeimplementations, the functions noted in the blocks may occur out of theorder noted in the figures. For example, two blocks shown in successionmay, in fact, be executed substantially concurrently, or the blocks maysometimes be executed in the reverse order, depending upon thefunctionality involved. It will also be noted that each block of theblock diagrams and/or flowchart illustration, and combinations of blocksin the block diagrams and/or flowchart illustration, can be implementedby special purpose hardware-based systems that perform the specifiedfunctions or acts or carry out combinations of special purpose hardwareand computer instructions.

Reference in the specification to “one embodiment” or “an embodiment” ofthe present principles, as well as other variations thereof, means thata particular feature, structure, characteristic, and so forth describedin connection with the embodiment is included in at least one embodimentof the present principles. Thus, the appearances of the phrase “in oneembodiment” or “in an embodiment”, as well any other variations,appearing in various places throughout the specification are notnecessarily all referring to the same embodiment.

It is to be appreciated that the use of any of the following “/”,“and/or”, and “at least one of”, for example, in the cases of “A/B”, “Aand/or B” and “at least one of A and B”, is intended to encompass theselection of the first listed option (A) only, or the selection of thesecond listed option (B) only, or the selection of both options (A andB). As a further example, in the cases of “A, B, and/or C” and “at leastone of A, B, and C”, such phrasing is intended to encompass theselection of the first listed option (A) only, or the selection of thesecond listed option (B) only, or the selection of the third listedoption (C) only, or the selection of the first and the second listedoptions (A and B) only, or the selection of the first and third listedoptions (A and C) only, or the selection of the second and third listedoptions (B and C) only, or the selection of all three options (A and Band C). This may be extended, as readily apparent by one of ordinaryskill in this and related arts, for as many items listed.

Referring now to FIG. 4, a BTD testing system 400 is shown. In thisembodiment, BTD testing is performed by a single, remote device, but itshould be understood that alternative embodiments may be in the form ofa distributed or cloud computing solution. The BTD testing system 400includes a hardware processor 402 and memory 404. The BTD testing system400 also includes a network interface 406 that enables the BTD testingsystem to communicate with one or more end-user systems 102. Inaddition, the BTD testing system 400 may include functional modules thatare implemented as software that stored in memory 404 and executed byprocessor 402. In alternative embodiments, the functional modules may beimplemented as one or more discrete hardware components in the form of,e.g., application-specific integrated chips or field programmable gatearrays.

For example, an image analysis module 408 communicates with the end-usersystems 102 to provide text test cases to the end-user systems 102 andto receive captured images from the end-user systems 102. The imageanalysis module 408 performs any needed operations on the capturedimages, including noise filtering and resizing the images, to produceclean images. An image comparison module 410 then compares the cleanimages to reference images that are stored in the memory 404 in imagerepository 412 and determines for each test case whether the textdisplayed at the end-user system 102 matches the reference image. Theimage comparison module 410 further uses one or more rules to determinewhether the pattern of image matches and mismatches represents a BTDerror and, if so, block 414 includes such information in a reportprovided to the end user.

Referring now to FIG. 5, an exemplary processing system 500 is shownwhich may represent the BTD testing system 400. The processing system500 includes at least one processor (CPU) 504 operatively coupled toother components via a system bus 502. A cache 506, a Read Only Memory(ROM) 508, a Random Access Memory (RAM) 510, an input/output (I/O)adapter 520, a sound adapter 530, a network adapter 540, a userinterface adapter 550, and a display adapter 560, are operativelycoupled to the system bus 502.

A first storage device 522 and a second storage device 524 areoperatively coupled to system bus 502 by the I/O adapter 520. Thestorage devices 522 and 524 can be any of a disk storage device (e.g., amagnetic or optical disk storage device), a solid state magnetic device,and so forth. The storage devices 522 and 524 can be the same type ofstorage device or different types of storage devices.

A speaker 532 is operatively coupled to system bus 502 by the soundadapter 530. A transceiver 542 is operatively coupled to system bus 502by network adapter 540. A display device 562 is operatively coupled tosystem bus 502 by display adapter 560.

A first user input device 552, a second user input device 554, and athird user input device 556 are operatively coupled to system bus 502 byuser interface adapter 550. The user input devices 552, 554, and 556 canbe any of a keyboard, a mouse, a keypad, an image capture device, amotion sensing device, a microphone, a device incorporating thefunctionality of at least two of the preceding devices, and so forth. Ofcourse, other types of input devices can also be used, while maintainingthe spirit of the present principles. The user input devices 552, 554,and 556 can be the same type of user input device or different types ofuser input devices. The user input devices 552, 554, and 556 are used toinput and output information to and from system 500.

Of course, the processing system 500 may also include other elements(not shown), as readily contemplated by one of skill in the art, as wellas omit certain elements. For example, various other input devicesand/or output devices can be included in processing system 500,depending upon the particular implementation of the same, as readilyunderstood by one of ordinary skill in the art. For example, varioustypes of wireless and/or wired input and/or output devices can be used.Moreover, additional processors, controllers, memories, and so forth, invarious configurations can also be utilized as readily appreciated byone of ordinary skill in the art. These and other variations of theprocessing system 500 are readily contemplated by one of ordinary skillin the art given the teachings of the present principles providedherein.

Referring now to FIG. 6, illustrative cloud computing environment 50 isdepicted. As shown, cloud computing environment 50 comprises one or morecloud computing nodes 10 with which local computing devices used bycloud consumers, such as, for example, personal digital assistant (PDA)or cellular telephone 54A, desktop computer 54B, laptop computer 54C,and/or automobile computer system 54N may communicate. Nodes 10 maycommunicate with one another. They may be grouped (not shown) physicallyor virtually, in one or more networks, such as Private, Community,Public, or Hybrid clouds as described hereinabove, or a combinationthereof. This allows cloud computing environment 50 to offerinfrastructure, platforms and/or software as services for which a cloudconsumer does not need to maintain resources on a local computingdevice. It is understood that the types of computing devices 54A-N shownin FIG. 6 are intended to be illustrative only and that computing nodes10 and cloud computing environment 50 can communicate with any type ofcomputerized device over any type of network and/or network addressableconnection (e.g., using a web browser).

Referring now to FIG. 7, a set of functional abstraction layers providedby cloud computing environment 50 (FIG. 6) is shown. It should beunderstood in advance that the components, layers, and functions shownin FIG. 6 are intended to be illustrative only and embodiments of theinvention are not limited thereto. As depicted, the following layers andcorresponding functions are provided:

Hardware and software layer 60 includes hardware and softwarecomponents. Examples of hardware components include: mainframes 61; RISC(Reduced Instruction Set Computer) architecture based servers 62;servers 63; blade servers 64; storage devices 65; and networks andnetworking components 66. In some embodiments, software componentsinclude network application server software 67 and database software 68.

Virtualization layer 70 provides an abstraction layer from which thefollowing examples of virtual entities may be provided: virtual servers71; virtual storage 72; virtual networks 73, including virtual privatenetworks; virtual applications and operating systems 74; and virtualclients 75.

In one example, management layer 80 may provide the functions describedbelow. Resource provisioning 81 provides dynamic procurement ofcomputing resources and other resources that are utilized to performtasks within the cloud computing environment. Metering and Pricing 82provide cost tracking as resources are utilized within the cloudcomputing environment, and billing or invoicing for consumption of theseresources. In one example, these resources may comprise applicationsoftware licenses. Security provides identity verification for cloudconsumers and tasks, as well as protection for data and other resources.User portal 83 provides access to the cloud computing environment forconsumers and system administrators. Service level management 84provides cloud computing resource allocation and management such thatrequired service levels are met. Service Level Agreement (SLA) planningand fulfillment 85 provide pre-arrangement for, and procurement of,cloud computing resources for which a future requirement is anticipatedin accordance with an SLA.

Workloads layer 90 provides examples of functionality for which thecloud computing environment may be utilized. Examples of workloads andfunctions which may be provided from this layer include: mapping andnavigation 91; software development and lifecycle management 92; virtualclassroom education delivery 93; data analytics processing 94;transaction processing 95; and source code optimization 96.

Having described preferred embodiments of on-demand testing as a servicefor base text direction verification testing (which are intended to beillustrative and not limiting), it is noted that modifications andvariations can be made by persons skilled in the art in light of theabove teachings. It is therefore to be understood that changes may bemade in the particular embodiments disclosed which are within the scopeof the invention as outlined by the appended claims. Having thusdescribed aspects of the invention, with the details and particularityrequired by the patent laws, what is claimed and desired protected byLetters Patent is set forth in the appended claims.

What is claimed is:
 1. A method for testing base text direction (BTD),comprising: receiving one or more images captured by an end-user system,each of said one or more images displaying respective text test caseinformation; comparing each of said one or more images to a respectivereference image associated with a respective text test case; anddetermining whether the end-user system produces BTD errors based on thecomparison in accordance with one or more BTD error rules.
 2. The methodof claim 1, further comprising transmitting the text test caseinformation to the end-user system.
 3. The method of claim 2, whereinthe transmitted text test case information comprises a text string andan associated BTD.
 4. The method of claim 2, wherein the transmittedtext test case information comprises a font definition, a font size, andimage capture information that defines text position and image size. 5.The method of claim 1, further comprising filtering the received one ormore images prior to said comparison to remove noise.
 6. The method ofclaim 1, wherein comparing each of said one or more images to arespective reference image comprises determining a similarity betweenimages using a similarity metric to produce a respective similarityscore.
 7. The method of claim 6, wherein comparing each of said one ormore images to a respective reference image further comprises comparingthe respective similarity score to a similarity threshold anddetermining that each of said one or more images matches the respectivereference image if the respective similarity score exceeds thesimilarity threshold.
 8. The method of claim 1, wherein the one or moreBTD error rules each comprise a set of matching test cases and a set ofmismatching test cases associated with each of a plurality of types ofBTD error.
 9. The method of claim 1, wherein each test case includestext from a first language that is displayed left-to-right and text froma second language that is displayed right-to-left.
 10. A non-transitorycomputer readable storage medium comprising a computer readable programfor improving content accessibility, wherein the computer readableprogram when executed on a computer causes the computer to perform thesteps of claim
 1. 11. A method for testing base text direction (BTD),comprising: transmitting text test case information that comprises atext string and an associated BTD to an end-user system receiving one ormore images captured by the end-user system, each of said one or moreimages displaying respective text test case information; filtering thereceived one or more images to remove noise; comparing each of saidfiltered one or more images to a respective reference image associatedwith a respective text test case; and determining whether the end-usersystem produces BTD errors based on the comparison in accordance withone or more BTD error rules, wherein each BTD error rule comprises a setof matching test cases and a set of mismatching test cases associatedwith each of a plurality of types of BTD error.
 12. A system for testingbase text direction, comprising: a network interface configured toreceive one or more images captured by an end-user system, each of saidone or more images displaying respective text test case information; animage comparison module comprising a processor configured to compareeach of said one or more images to a respective reference imageassociated with a respective text test case and to determine whether theend-user system produces BTD errors based on the comparison inaccordance with one or more BTD error rules.
 13. The system of claim 12,wherein the network interface is further configured to transmit the texttest case information to the end-user system.
 14. The system of claim13, wherein the transmitted text test case information comprises a textstring and an associated BTD.
 15. The system of claim 13, wherein thetransmitted text test case information comprises a font definition, afont size, and image capture information that defines text position andimage size.
 16. The system of claim 12, further comprising an imageanalysis module configured to filter the received one or more imagesprior to image comparison to remove noise.
 17. The system of claim 12,wherein the image comparison module is further configured to determine asimilarity between images using a similarity metric to produce arespective similarity score.
 18. The system of claim 17, wherein theimage comparison module is further configured to compare each respectivesimilarity score to a similarity threshold and to determine that each ofsaid one or more images matches the respective reference image if therespective similarity score exceeds the similarity threshold.
 19. Thesystem of claim 12, wherein the one or more BTD error rules eachcomprise a set of matching test cases and a set of mismatching testcases associated with each of a plurality of types of BTD error.
 20. Thesystem of claim 12, wherein each test case includes text from a firstlanguage that is displayed left-to-right and text from a second languagethat is displayed right-to-left.